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A MESSAGE FROM THE FRIEDMAN FOUNDATION: 



OUR CHALLENGE TO YOU 



Our research adheres to the highest standards of scientific rigor. We 
know that one reason the school choice movement has achieved such 
great success is because the empirical evidence really does show that 
school choice works. More and more people are dropping their oppo- 
sition to school choice as they become familiar with the large body 
of high-quality scientific studies that supports it. Having racked up a 
steady record of success through good science, why would we sabotage 
our credibility with junk science? 

This is our answer to those who say we can't produce credible research 
because we aren't neutral about school choice. Some people think that 
good science can only be produced by researchers who have no opin- 
ions about the things they study. Like robots, these neutral researchers 
are supposed to carry out their analyses without actually thinking or 
caring about the subjects they study. 

But what's the point of doing science in the first place if we're never al- 
lowed to come to any conclusions? Why would we want to stay neutral 
when some policies are solidly proven to work, and others are proven 
to fail? 

That's why it's foolish to dismiss all the studies showing that school 
choice works on grounds that they were conducted by researchers who 
think that school choice works. If we take that approach, we would 
have to dismiss all the studies showing that smoking causes cancer, 
because all of them were conducted by researchers who think that 
smoking causes cancer. We would end up rejecting all science across 
the board. 

The sensible approach is to accept studies that follow sound scientific 
methods, and reject those that don't. Science produces reliable empiri- 
cal information, not because scientists are devoid of opinions and mo- 
tives, but because the rigorous procedural rules of science prevent the 
researchers' opinions and motives from determining their results. If 
research adheres to scientific standards, its results can be relied upon 
no matter who conducted it. If not, then the biases of the researcher 
do become relevant, because lack of scientific rigor opens the door for 
those biases to affect the results. 

So if you're skeptical about our research on school choice, this is our 
challenge to you: prove us wrong. Judge our work by scientific stan- 
dards and see how it measures up. If you can find anything in our work 
that doesn't follow sound empirical methods, by all means say so. We 
welcome any and all scientific critique of our work. But if you can't find 
anything scientifically wrong with it, don't complain that our findings 
can't be true just because we're not neutral. That may make a good 
sound bite, but what lurks behind it is a fiat rejection of science. 
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Executive Summary 

This study examines the Florida Tax Credit Scholarship program, one of the nation’s largest school choice 
programs. It is the first ever completed empirical evaluation of a tax-credit scholarship program, a type of program 
that creates school choice through the tax code. Earlier reports, including a recent one on the Florida program, have 
not drawn comparisons between the educational results of public schools and tax-credit scholarships; this study is 
therefore the first step in evaluating the performance of this type of school choice. 

The Florida program provides a tax credit on corporate income taxes for donations to scholarship-funding 
organizations, which use the funding to provide K-12 private school scholarships to low-income students. Over 23,000 
Florida students are attending private schools this year using these scholarships. Similar programs exist in Arizona, 
Georgia, Iowa, Indiana, Pennsylvania and Rhode Island. 

Studying a tax-credit scholarship program using traditional empirical techniques presents a number of 
methodological challenges. To overcome these difficulties, the study used a telephone survey conducted by Marketing 
Informatics to interview 808 participating parents whose children attended public schools before entering the program. 
It asked them to compare the educational services they received in public and private schools. 

The results provide the first ever direct comparison between the education participants received when they were 
in Florida public schools and the education they receive in the school choice program. 

Key findings include: 

■ Participating parents report that they receive dramatically better educational services from their 
current private schools than they previously received in public schools. 

• 80 percent are “very satisfied” with the academic progress their children are making 
in their current private schools, compared to 4 percent in their previous public 
schools. 

• 80 percent are “very satisfied” with the individual attention their children now receive, 
compared to 4 percent in public schools. 

• 76 percent are “very satisfied” with the teacher quality in their current schools, 
compared to 7 percent in public schools. 

• 76 percent are “very satisfied” with their schools’ responsiveness to their needs, 
compared to 4 percent in public schools. 

• 62 percent are “very satisfied” with the student behavior in their current schools, 
compared to 3 percent in public schools. 

■ Most participating parents were dissatisfied with their public school experiences on most measurements, 
and are overwhelmingly satisfied with their current private schools. 

• 58 percent had been “dissatisfied” or “very dissatisfied” with the academic progress 
their children were making in public school, compared to 4 percent in their current 
private schools. 

• 64 percent had been “dissatisfied” or “very dissatisfied” with the individual attention 
their children received in public schools, compared to 3 percent in their current 
schools. 

• 44 percent had been “dissatisfied” or “very dissatisfied” with teacher quality in public 
schools, compared to 3 percent in their current schools. 

• 59 percent had been “dissatisfied” or “very dissatisfied” with school responsiveness 
in public schools, compared to 3 percent in their current schools. 

• 62 percent had been “dissatisfied” or “very dissatisfied” with student behavior in 
public schools, compared with 5 percent in their current schools. 



■ Asked to rate their schools on a scale from one to ten, 94 percent of participants gave their current private schools at least 
a seven, and 54 percent gave them a ten. Only 18 percent of parents rated their public schools seven or higher, and just 2 
percent rated them at the highest level. 

■ Of the 128 parents whose children are not likely to be in the program again next year, 81 percent said that dissatisfaction 
with the program played no role at all in their decision, and 100 percent - all 128 of them - said the program should continue 
to be available for others even though they were not likely to use it again next year themselves. 
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An Empirical Evaluation of the Florida Tax Credit Scholarship Program 



Introduction 

Created in 2001, the Florida Tax Credit Scholarship Program extends school choice to Florida students through the tax code. 
It provides corporations with a dollar-for-dollar credit on their state income taxes for donating money to Scholarship Funding 
Organizations (SFOs). These SFOs use the donations to provide K-12 private school scholarships to low-income students. 

The scholarship is equal to $3,950 or the actual tuition and fees charged by the school, whichever is less. In February 2009, 
a total of 23,259 students were attending private schools using these scholarships. 1 This makes the Florida Tax Credit Scholarship 
Program one of the nation’s largest school choice programs. 

Corporations may receive these dollar-for-dollar credits for up to 75 percent of their total income tax liability. The total size 
of the program is capped at $118 million. A 2009 expansion of the program made insurance companies with premium tax liabilities 
eligible to donate. 

To enter the program, families must have an income low enough to qualify for the federal free and reduced-price lunch program 
($39,220 for a family of four in 2008). Also, students must either have attended a Florida public school for the full year prior to the 
scholarship award or be entering kindergarten or first grade. Additionally, some students transitioned into the program from the 
state’s Opportunity Scholarship Program (the “A+” program) when it was ended. 

This study is the first ever completed empirical evaluation of a tax-credit scholarship program. Florida has initiated an official 
evaluation of its program, which will compare test scores of participants to those of the general Florida population who are eligible 
for free and reduced-price lunch programs. A recent report released by David Figlio, the lead investigator of the study, received 
widespread attention in Florida. However, that study has not yet been able to conduct any statistically valid comparison of the test 
scores, owing to difficulties in collecting the baseline data. The analysis is expected to be released in 2010, after an additional year 
of data-gathering has been conducted. 2 

Method 

Studying a tax-credit scholarship program presents numerous methodological difficulties. This helps explain why no previous 
empirical evaluation of a tax-credit scholarship program has been completed. 

The most important issue is the difficulty of overcoming selection bias. Students who apply to school choice programs can 
reasonably be expected to differ from students who do not apply to school choice programs in ways that are not immediately 
observable. For example, they may have parents who place a higher priority on their education. These unobserved differences 
between participating students and their public school peers make it challenging to draw a statistically valid comparison between 
participants and a control group drawn from students who have not applied to the program. 

Some school voucher programs allow researchers to overcome this difficulty because they use random lotteries to hand out 
vouchers when the program is oversubscribed. This creates a naturally occurring “random assignment experiment,” just like the 
method used in medical trials. In these cases, researchers can compare students who won the lottery and were offered vouchers 
with students who applied for vouchers but lost the lottery and were not offered them. 

Because random assignment is the gold standard for scientific research, the body of random assignment studies on vouchers 
has become the touchstone for evaluating their performance. Ten random assignment studies of vouchers have been conducted; of 
these, six found that the total population offered vouchers were outperforming the control group, and three more found that large 
subgroups of the voucher population were outperforming the control group, while the rest were no worse off. The tenth study found 
no visible difference, but was marred by serious violations of scientific procedure; if these violations are corrected, the data from 
this study show the voucher students outperforming the control group. 3 

However, this type of research has not been possible for tax-credit scholarship programs. These programs do not use random 
lotteries when they are oversubscribed, so there is no naturally occurring random assignment experiment. 

Instead, this study examines a different question: how do the educational services participants are receiving through the 
program compare to the services those same participants previously received in public schools? This approach eliminates the 
difficulty of drawing accurate comparisons, since we are looking at the exact same students in both public schools and the school 
choice program. 

Of course, this approach has a corresponding limitation. We are narrowing the scope of analysis to include only the services 
these particular students received before and after they entered the program. This limits the type of analysis we can perform. It 
means we are conducting a descriptive analysis showing how the services received by these students changed when they entered the 
program. We are unable to provide a measurement for what kind of services they would have received if they had not participated, 
and instead focus solely on current participants. The results measure how their educational services changed when they entered 
the program, and we should use caution about generalizing from their experiences to those that others might have had. 
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